Learning of correlated patterns by simple perceptrons
نویسندگان
چکیده
Learning behavior of simple perceptrons is analyzed for a teacher-student scenario in which output labels are provided by a teacher network for a set of possibly correlated input patterns, and such that teacher and student networks are of the same type. Our main concern is the effect of statistical correlations among the input patterns on learning performance. For this purpose, we extend to the teacher-student scenario a methodology for analyzing randomly labeled patterns recently developed in J. Phys. A: Math. Theor. 41, 324013 (2008). This methodology is used for analyzing situations in which orthogonality of the input patterns is enhanced in order to optimize the learning performance. PACS numbers: 02.50.-r, 84.35.+i Learning of correlated patterns by simple perceptrons 2
منابع مشابه
On-line learning and generalisation in coupled perceptrons
We study supervised learning and generalisation in coupled perceptrons trained on-line using two learning scenarios. In the first scenario the teacher and the student are independent networks and both are represented by an Ashkin-Teller perceptron. In the second scenario the student and the teacher are simple perceptrons but are coupled by an Ashkin-Teller type four-neuron interaction term. Exp...
متن کاملOne Cell to Rule Them All, and in the Dendrites Bind Them
More than 60 years ago, the McGill University professor Donald Hebb published his famous postulate stating that to store a memory trace, the connection from a neuron that persistently helps activate another one should be strengthened (Hebb, 1949). Inspired by Hebb’s postulate, Rosenblatt (1958) a decade later introduced the perceptron learning machine as a simplified model of information storag...
متن کاملApplications of Machine Learning Techniques to Systems
Perceptrons is a simple neural network that works as an alternative to the commonly used two-bit counters branch history table (BHT) branch predictor. Perceptrons achieves increased accuracy than traditional BHT branch predictors because they can make use of longer branch histories, given the same hardware budget. Although having very similar organization to BHT branch predictors, Perceptrons’ ...
متن کاملTitle of Document : APPLYING PERCEPTRONS TO SPECULATION IN COMPUTER ARCHITECTURE
Title of Document: APPLYING PERCEPTRONS TO SPECULATION IN COMPUTER ARCHITECTURE Michael David Black, Ph.D., 2007 Directed By: Professor Manoj Franklin, Electrical and Computer Engineering Speculation plays an ever-increasing role in optimizing the execution of programs in computer architecture. Speculative decision-makers are typically required to have high speed and small size, thus limiting t...
متن کاملLearning algorithms for perceptrons from statistical physics
Learning algorithms for perceptrons are deduced from statistical mechanics. Thermodynamical quantities are used as cost functions which may be extremal12ed by gradient dynamics to find the synaptic efficacies that store the learning set of patterns. The learning rules so obtained are classified in two categories, following the statistics used to derive the cost functions, namely, Bolt2mann stat...
متن کامل